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A MEDICAL IMAGING SYSTEM FOR MAPPING A STRUCTURE IN A 
PATIENT'S BODY 

FIELD OF THE INVENTION 

5 The present invention relates to a medical imaging system for mapping a structure of 

a patient's body using a medical instrument and three-dimensional imaging. The present 
invention also relates to a method to be used in said medical imaging system. 

Such an invention is used for guiding the placement and operation of an invasive 
medical instrument in a body organ, in particular the heart. 

10 

BACKGROUND OF THE INVENTION 

Clinical applications in which an invasive medical instrument has to be guided into 
the body of a patient are becoming widespread. Notably the growing interest in minimally 
invasive methods for the treatment of cardiac diseases necessitates the development of 

15 methods and devices allowing the physician to guide a medical instrument to predetermined 
positions inside or outside the heart. In electrophysiology for example, it is necessary to 
guide a catheter to a plurality of positions on the ventricular or atrial walls in order to 
measure an electrical pulse or to burn wall tissues. 

A method and system for mapping a structure in the body of a patient is disclosed in 

20 the European Patent Application published with publication number EP1 1 8261 9 A2. A three- 
dimensional image data set of the structure is captured. A 3D geometrical map of the 
structure is generated using a medical intrument inserted into the structure in the following 
way: the medical instrument, which is equipped with a position sensor, is brought into 
contact with the structure at a multiplicity of locations on the structure, which are recorded on 

25 the 3D geometrical map. The 3D image data set is registered with the map, such that each of 
a plurality of image points in the 3D image data set is associated with a corresponding point 
in the 3D geometrical map. The 3D geometrical map is displayed such that diagnostic 
information directly coming or derived from the 3D image data set, for example related to 
blood flow in the structure, is displayed at the corresponding map point. 

30 Such a method provides a solution for generating a 3D geometrical frame model of 

the structure from the locations provided by the medical instrument, in which the diagnostic 
information provided by the 3D image data set could be mapped. The locations of the 
medical instrument have to be chosen such that a geometrical shape of the structure can be 
built up. Based on the combined diagnostic and geometrical information, a user operating the 

35 catheter is able to identify and visualize areas of the structure, for example the heart, that are 



WO 2005/111942 PCT/IB2005/051575 

2 



in need of treatment. A drawback of such a method is that it does not take into account the 
fact that the structure may have moved between two successive measurements of the medical 
instrument. Therefore, the obtained 3D map is not accurate. 

5 SUMMARY OF THE INVENTION 

It is an object of the invention to provide a system which generates a 3D map of a 
structure of a patient's body, which is more accurate. 

This is achieved by a medical imaging system comprising: 

- acquisition means for acquiring a plurality of three-dimensional (3D) image data sets of a 
10 structure of a body of a subject, 

- a medical instrument for performing a plurality of actions at a plurality of points in 
contact with said structure, 

- means for associating one of said plurality of points with one of said plurality of 3D 
image data sets, 

15 - means for computing a reference 3D image data set from said plurality of 3D image data 
sets, 

- means for defining a transformation for matching said one of said plurality of 3D image 
data sets with said reference 3D image data set, 

- means for applying said matching transformation to the points of said plurality of points 
20 which are associated with said one of said 3D image data sets, 

means for visualizing said transformed points. 

With the invention, the structure of the body, for instance a heart cavity, is explored from 
the inside using the medical instrument placed inside the structure, and from the outside 
25 using the 3D image acquisition means. 

The acquisition means are adapted to successively acquire a plurality of 3D image data 
sets of said structure, for example 3D ultrasound image data sets using an ultrasound probe. It 
should be noted that imaging modalities other than ultrasound, such as CT or X-ray, may be 
used as well. An advantage of ultrasound imaging is that it shows the structure wall and 
30 vascularities. An advantage of acquiring a plurality of 3D image data sets is that they show 
an evolution of the structure in time. As a matter of fact, a structure of the body like, for 
instance, the heart is expected to move and change shape due to contractions during the 
cardiac cycle. 
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The medical instrument is adapted to perform a plurality of actions, for instance 
measuring an electrical activity or burning a tissue at a plurality of location points of the 
structure wall with which it is brought into contact. In the first case, the objective is to 
completely and uniformly map the structure wall. In the second case, the objective is to 
5 precisely reach desired points of the structure wall. These actions are performed successively 
by the medical instrument within a certain period of time. 

The associating means are intended to associate a point with a 3D image data set. 
Advantageously, a point corresponding to an action performed at time t is associated with a 
3D image data set acquired at the same time instant or at a time instant which is very close to 
10 time t. An advantage is that the associated 3D image data set provides information about the 
background of the structure at the instant when the action has been performed by the medical 
instrument. 

The means for computing a reference 3D image data set from said plurality of 3D image 
data sets are intended to derive a reference 3D image data set, for instance, from a 
15 combination of the last two acquired 3D image data sets. Said reference 3D image data set 
can simply be chosen as a 3D image data set from the plurality of 3D image data sets as well. 

For each 3D image data set, which has been associated with at least one point, a 
transformation is defined for matching said 3D image data set with said reference image data 
set. Such an operation is repeated for the points which are associated with another 3D image 
20 data set, using another transformation. In this way, these transformed points are registered 
with respect to the reference 3D image data set. 

The visualization means are then adapted to provide a visualization of the transformed 
points, thereby forming a map of the structure. Such a map comprises at each action point a 
result of the action performed, for example, a measure or an indication that the tissue has 
25 been burnt. 

Therefore, the map obtained with the invention is more accurate, because an adapted 
transformation has been applied to each point, which compensates for any deformation or 
motion undergone by the structure in the time between the acquisition of the reference image 
data set and the acquisition of the associated 3D image data set. 
30 Advantageously, the means for visualizing said transformed points comprise sub-means 

for generating a representation, in which the transformed points are superimposed either with 
the reference 3D image data set or with the current 3D image data set acquired at time t after 
transformation by the matching transformation defined for the current 3D image data set. A 
first advantage is that such a superimposition may help the user to place the action points in 
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relation to the surrounding anatomy. Another advantage is that said representation may help 

the user to decide where to perform a next action. 

In a first embodiment of the invention, the reference image data set is chosen as a fixed 

3D image data set, for instance acquired at a time tj. In other words, a fixed map is generated 
5 and each new point is registered with respect to said fixed reference. An advantage is that 

reading of the map is facilitated because, when a new point appears on the map, the points 

which have been previously processed remain unchanged. 

In a second embodiment of the invention, the reference image data set is chosen as a 

current 3D image data set acquired at a current time t In this case, an up-to-date map is 
10 obtained, which moves with the structure. An advantage is that at the current time t the 

visualized map corresponds to the real state of the structure in the body. The generated map 

is also more realistic, because it moves with the structure. 

In a third embodiment of the invention, a geometrical transformation is applied to the 

reference 3D image data set The objective is for example to ensure that the structure and 
15 consequently the map is visualized in a given orientation, which is familiar* to the user. An 

advantage is that such a geometrically transformed map can be more easily interpreted by the 

user. 

In a fourth embodiment of the invention, the visualization means are adapted to provide a 
view of a region of interest of the medical instrument. A first advantage of this fourth 
20 embodiment of the invention is that it provides a zoom-in of the vicinity of the medical 

instrument, which improves the visualization of the region of interest A second advantage is 
that such a view provides another perspective of the structure. Therefore, combined with the 
representation, such a view may help the user to define a next location for performing an 
action with the medical instrument in a quicker and more efficient way. 

25 

These and other aspects of the invention are apparent from and will be elucidated with 
reference to the embodiments described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 The present invention will now be described in more detail, by way of example, with 

reference to the accompanying drawings, wherein: 

- Fig. 1 is a schematic drawing of a system in accordance with the invention, 

- Fig. 2 is a schematic drawing of the association means in accordance with the invention. 
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- Fig. 3 is a schematic drawing of the means for localizing a 3D image data set in 
accordance with the invention, 

- Fig. 4 is a schematic drawing of the means for defining a transformation in accordance 
with the invention, 

5 - Fig. 5 is a schematic drawing of the means for applying the transformation defined for a 
3D image data set to the points associated with said 3D image data set in accordance with 
the invention, 

- Fig. 6 is a schematic drawing of a map provided by the visualization means in accordance 
with the invention, 

10 - Fig. 7 is a schematic drawing of a representation in which the transformed points are 
superimposed with the reference 3D image data set in accordance with a first 
embodiment of the invention, 

- Fig. 8 is a schematic drawing of a representation in which the transformed points are 
superimposed with the reference 3D image data set in accordance with a second 

1 5 embodiment of the invention, 

- Fig. 9 is a schematic drawing of the means for applying a geometrical transformation to 
the reference 3D image data set in accordance with a third embodiment of the invention, 

- Fig. 10 is a schematic drawing of a view of a region of interest of the medical instrument 
provided by the visualization means in accordance with a fourth embodiment of the 

20 invention, 

- Fig. 1 1 is a schematic representation of a method in accordance with the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates to a system for mapping a structure of a patient's body 
25 using a medical instrument and three-dimensional imaging. In the following, the system in 
accordance with the invention will be described in more detail by means of, in this case, the 
application of an electrophysiology catheter introduced into a heart cavity, for instance the 
left ventricular or the right atrium chamber, in order to measure an electrical activity of the 
heart or to burn diseased tissues. 
30 However, the invention is not limited to electrophysiology procedures and can more 

generally be used for guiding any other medical instrument in the patient's body, like for 
instance a needle. 

The schematic drawing of Fig. 1 shows a patient 1, who is arranged on a patient table 
2 and whose symbolically indicated heart 3 is subjected to a treatment by means of a catheter 
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4 introduced into the body. The system in accordance with the invention comprises means 5 
for acquiring a plurality of 3D image data sets of the structure 3DIS(ti), 3DIS(t 2 ),...,3DIS(t). 
In the following, the plurality of 3D image data sets is a plurality of ultrasound image data 
sets acquired from an ultrasound probe 6, which has been placed on the patient's body and 
5 fixed by fixation means, for instance a belt 7 or a stereotactic arm. It should be noted 

however that the invention is not limited to ultrasound acquisition means and that CT, MRI 
or X-Ray acquisition means could be used as well. 

Advantageously, the 3D acquisition means 5 are adapted to provide a live 3D image 
data set. For instance, the 3D image data sets 3DIS(t]), 3DIS(t 2 ),...,3DIS(t) are acquired at 
10 predetermined phases of the cardiac cycle. It should be noted however that they can be 
acquired at any phase of the cardiac cycle as well. 

The plurality of 3D image data sets is stored in a memory 6. 

The system in accordance with the invention comprises a medical instrument 4 to be 
guided inside the structure 3 for performing a plurality of actions at a plurality of location 
15 points Pi, P2, Pm, where M is an integer, in contact with said structure. Said plurality of 
actions is controlled by a controller 8 and the results of this plurality of actions are stored in a 
memory 8. 

The system in accordance with the invention further comprises means 9 for associating 
one of said plurality of points Pj with one of said plurality of 3D image data sets 3DIS(t,), ' 

20 means 1 0 for computing a reference 3D image data set 3DIS(ir) from said plurality of 3D 
image data sets, means 11 for defining a transformation TR(t{) for matching said one of said 
plurality of 3D image data sets 3DIS(ti) with the reference 3D image data set 3DIS(t R ), means 
12 for applying said matching transformation TR(ti) to the points Pj of said plurality of points 
which are associated with said one of said 3D image data sets 3DIS(tj) and means 13 for 

25 visualizing said transformed points TR(t»)Pj using display means 14. 

In acordance with the invention, the medical instrument 4 has an extremity, which is 
adapted to perform an action Aj, such as measuring an electrical activity or burning a tissue, 
when it is brought into contact with a location point Pj of the inside wall of the structure. In 
the particular case of an electrophysiology procedure, this extremity of the catheter 4 is called 

30 a tip. Advantageously, the controller 8 comprises sub-means for localizing the tip of the 
catheter, which give the precise location of the location point contacted by the medical 
instrument. In a first alternative, the medical instrument 4 is equipped with an active 
localizer, for instance an RF coil, as described above for localizing the ultrasound probe 6. 
Said tip is a small and thin segment, which is very echogenic and leaves a specific signature 
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in the 3D ultrasound image data set. In a second alternative, the tip localization sub-means 
advantageously employ image processing techniques, which are well known to those skilled 
in the art, for enhancing either a highly contrasted blob or an elongated shape in a relatively 
uniform background. 

5 Therefore, the tip localization sub-means are adapted to provide a location of a 

contact point Pj=(xj, y h z,) of the medical instrument 4 and the inside wall of the structure 3 at 
a time tj. In the first alternative, such a location is directly expressed in a fixed referential, for 
instance a referential (O, x, y, z) of the clinical intervention room. In the second alternative, it 
is firstly expressed in a local referential (0\ x', y', z') of the ultrasound probe 6 and 

10 converted into coordinates within the referential of the clinical intervention room (O, x, y, z) 
by conversion means, well-known to those skilled in the art. 

The system comprises means 9 for associating a location point Pj, j being an integer, 
with one 3D image data set from the plurality of 3D image data sets 3DIS(t,), 
3DIS(t 2 ),...,3DIS(t). Advantageously, the location point Pj, which corresponds to an action Aj 

15 performed at a time instant tj, is associated with the 3D image data set 3DlS(tj) acquired at 
time ti, said time being the closest time to tj among the times of acquisition of the 3D image 
data sets 3DIS(t,) to 3DIS(t). 

Referring to Fig. 2, the location points P,, P 2 are therefore associated with the 3D 
image data set 3DIS(t,), the location point P 3 with the 3D image data set 3DIS(t 2 ), the 

20 location points P 4 , P 5 with the 3D image data set 3DIS(t 3 ) and the location point P 6 with the 

3D image data set 3DIS(t4>. 

An advantage is that the associated 3D image data set 3DIS(tj) can be considered to 
represent a state of the structure 3 at the instant tj at which the action was performed at the 
location point Pj. It should be noted that more than one location may be associated with one 

25 3D image data set. 

The means 10 are intended to derive a reference 3D image data set 3DIS(t R ). For 
instance, the reference 3D image data set 3DIS(t R ) is built up by combining the last two 
acquired 3D image data sets 3DIS(t-l) and 3DIS(t), especially if there is a location point 
acquired at a time close to t-1/2. Said reference 3D image data set can also simply be chosen 

30 as a 3D image data set from the plurality of 3D image data sets, for instance as the first 3D 
image data set 3DIS(t,) acquired at a time t, or the current 3D image data set 3DIS(t) 
acquired at a time t. In the following, it is assumed that the reference 3D image data set 
3DIS(t R ) has been acquired at a time tR, where R is an integer that is a priori different from i. 
Between time t R and time ti, both the ultrasound probe 6 and the structure 3 may have moved. 
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Referring to Fig. 3, the system further comprises means 1 1 for defining a 
transformation TR(tj) which matches the 3D image data set 3DIS(ti) with the reference 3D 
image data set 3DIS(t R ) in the fixed referential (O, x, y, z) of the clinical intervention room. 
Referring to Fig. 3, the system in accordance with the invention advantageously 

5 comprises means for localizing the ultrasound probe 6 in a fixed referential of coordinates 
with respect to the ultrasound probe, for instance the referential of coordinates (O, x, y, z) of 
the clinical intervention room. 

Such a localization is for instance based on an active localizer, well-known to those 
skilled in the art, which is arranged on the ultrasound probe 6. Said active localizer, for 

10 instance an RF coil, is intended to transmit an RF signal to an RF receiving unit placed under 
the patient's body and for instance integrated into the table 2. The RF receiving unit transmits 
the received signal to measuring means for measuring a position of the ultrasound probe 6 in 
the referential (O, x, y, z) of the clinical intervention room. It should be noted that the active 
localizer must provide a precise measurement of the position and of the orientation of the 

15 ultrasound probe 6, It should further be noted that a led-based optical localizer could be used 
as well. A first advantage of such a localization is that it is very precise. A second advantage 
is that it is performed in real-time and therefore can be triggered during the clinical 
procedure, if necessary. 

As already mentioned, the ultrasound probe 6 is likely to move during the clinical 

20 intervention due to external movements of the patient, such as respiratory movements. 

Therefore, means for localizing the ultrasound probe 6 are intended to provide a localization 
of the ultrasound probe 6 at a time ti, which simultaneously gives a localization of the 3D 
image data set acquired at time tj in the referential of coordinates (O, x, y, z). Such a 
localization completely defines a position and orientation of the ultrasound probe 6 and the 

25 3D image data set 3DIS(ti) within the referential (O, x, y, z) and for instance comprises the 

coordinates of a point O' and of three orthogonal vectors 0*X % , &T , O'Z' . 

Advantageously, a local referential of coordinates (O', x\ y', z')(t) is attached to the 
ultrasound probe 6 at time t. Such a referential (0\ x\ y\ z')(t) is particularly useful in order 
to localize structures of interest in the 3D image data set, such as the medical instrument 4 or 
30 the structure 3. Such a local referential moves with the 3D image data set. Therefore, a 

localization Loc(tj) of the local referential (0\ x', y\ z')(ti) attached to the 3D image data set 
3DIS(ti) and a localization Loc(t R ) of the local referential (0\ x', y\ z')0r) attached to the 
reference 3D image data set 3DIS(t R ) are provided within the referential (0, x, y, z) of the 
clinical intervention room. Consequently, a first transformation Tr(ti), which matches the 
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localizations Loc(ti) and Loc(t R ) can be defined within the referential (O, x, y, z) by the 
means 1 1 for defining a transformation. 

Advantageously, the means 1 1 for defining a transformation TR(tj), which matches the 
3D image data set 3DIS(tj) with the reference image data set 3DIS(t R ), comprises sub-means 

5 for segmenting the structure 3 both within the local referential (O, x', y', z')( t 5 ) and (O, x\ 
y', z')( t R ) of the ultrasound probe 6. 

Referring to Fig. 4, said sub-means are adapted to segment a first surface Sl(tj) of said 
structure in the 3D image data set 3DIS(ti) and a second surface Si(t R ) of said structure in the 
reference 3D image data set 3DIS(t R ). Given a set of points of said first surface S\(ti), a 

10 corresponding second set of points may be searched for use in the reference 3D image data 
set 3DIS(t R ) using, for instance, an Iterative Closest Point Algorithm, well known to those 
skilled in the art. The means for defining a transformation TR(tj) are adapted to seek a second 
transformation Tr'(ti), for instance from a family of transformations, that minimizes a mean 
square error between the first and second sets of points Si(t k ), Si(t R ). Advantageously, 

15 additional features like curvature measurements Ci(tj), Ci(t R ) may be used to improve the 
matching. The second transformation Tr'(ti) is then applied to all the points of the first 
surface Si(tj). 

It should be noted that the medical instrument 4 must not interfere in such a process of 
finding a matching transformation, since the medical instrument may have moved with 

20 respect to the structure 3. 

Therefore, referring to Fig. 4, the transformation TR(tj) may be decomposed into a 
first transformation Tr(ti), which matches the localization Loc(ti) of the local referential (O', 
x', y', z')(ti) of the ultrasound probe 6 within the referential (O, x, y, z) at time tj with the 
localization Loc(t R ) of the local referential (0\ x\ y', z')(ti0 of the ultrasound probe 6 at 

25 time t R , and into a second transformation Tr'(ti), which matches the structure 3 within the 3D 
image data set 3DIS(ti) with the structure 3 within the reference 3D image data set 3DIS(t R ). 

In this way, an adapted transformation TR(ti) is defined for each 3D image data set 
3DIS(ti) which has location points Pj associated with. Therefore, a plurality of 
transformations is defined during the clinical intervention. 

30 Referring to Fig. 5, the defined transformation TR(ti) is then applied by means 12 to 

the location point(s) Pj associated with the 3D image data set 3DIS(t 0 . In this way, a 
transformed location point TR(ti)Pj is obtained, which is registered with respect to the 
reference image data set 3DIS(t R ). 
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The system in accordance with the invention finally comprises means 13 for 
visualizing the plurality of transformed location points TR(ti)Pj, obtained by applying said 
plurality of transformations. 

Referring to Fig. 6, the plurality of transformed location points forms a map M of the 

5 structure 3 in which the result of the action Aj, for example a measurement value or an 

indication that the tissue has been burnt, is given at each transformed location point TR(tj)Pj. 
Said map is registered with respect to the reference 3D image data set 3DIS(t R ), because the 
plurality of location points Pi, P 2 ,..., Pm which constitutes this map has been registered by 
adapted transformations with respect to this reference image data set. 

1 0 The map M is displayed by display means 14. 

In a first embodiment of the invention, shown in Fig. 7, the reference 3D image data set 
TR(ti)Pj is a fixed 3D image data set, for example the first 3D image data set 3DIS(ti) 
acquired at time ti. Therefore, a location point Pj associated with a 3D image data set 3DIS(ti) 

15 is firstly transformed into a transformed point TR(ti)Pj by the transformation TR(ti), which 
matches the 3D image data set 3DIS(ti) with the reference 3D image data set 3DIS(t R ), and 
then visualized by the visualization means 13. 

In a first alternative, the means 13 for visualizing said transformed points comprise sub- 
means for generating a representation R, in which said transformed points TR(ti)Pj are 

20 superimposed with said reference 3D image data set 3DIS(t R ), as shown in Fig. 7. 

Therefore, the representation R provided by the visualization means 13 comprises a fixed 
anatomical background on which the transformed location points TR(ti)Pj are successively 
superimposed. It should be noted that, as shown in Fig. 7, the position of the medical 
instrument is a priori not updated. 

25 Advantageously, the system further comprises means for excluding the medical 

instrument 4 from the reference 3D image data set, for instance by using detection means 
based on image processing techniques which are well-known to those skilled in the art. 

A first advantage of such a representation is that it is obtained in a simple way, because a 
single transformation TR(tj) is applied to each location point Pj. A second advantage is that 

30 reading of the representation is facilitated because, when a new location point appears on the 
representation R, the points which have been previously processed remain unchanged. 

In a second alternative, the medical imaging system in accordance with the invention 
further comprises means for applying said transformation TR(ti) to the 3D image data set 
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3DIS(tO. A transformed 3D image data set TR(ti)3DIS(ti) is obtained, which is used to 
generate the representation R(t,) at time t { . Therefore, at time t$ the representation R(ti) shows 
the currently transformed location points TR(ti)Pj and the previously transformed points 
superimposed with the 3D image data set TR(tj)(3DIS(t;)). A first advantage is that in the 
5 representation R both the medical instrument 4 and the structure 3 are updated. Therefore, the 
anatomical background formed by the image data is up to date. Moreover, by applying the 
transformation TR(tj) to the 3D image data set 3DIS(tj), compensation is provided for any 
motion of the structure 3 with respect to the reference 3D image data set 3DIS(t R ). 
Consequently, a second advantage is that the guiding of the medical instrument to a next 
1 0 target point is facilitated 



In a second embodiment of the invention, shown in Fig. 8, the reference image data set 
3DIS(tR) is chosen as a 3D image data set acquired at a current time t, for example, as the 
current 3D image data set In this case, an up-to-date representation R(t) is obtained, which 
15 moves with the structure 3. In this case, a new location point Pj associated with the 3D image 
dataset 3DIS(t) is superimposed without any transformation to the reference 3D image data 
set 3DISr(i), because it corresponds to the current 3D image data set with which it is 
associated. In this case, all the previously acquired location points which have been 
superimposed to the previous reference 3D image data set 3DIS(t-l) in order to form the 
20 representation R(t-l) at time t-1 need to be registered with respect to the reference 3D image 
data set 3DIS(t) at time t so that the representation can be updated. 

In a first alternative, referring to Fig. 8, the previously acquired location points 
superimposed with the previous reference 3D image data set 3DIS(t-l) are all transformed, 
by an identical update transformation TR up (t) which matches the reference 3D image data set 
25 3DIS(t-l) at time t-1 with the reference 3D image data set 3DIS(t) at time t, into transformed 
points TRu P (t)Pi, TR up (t)P 2 , TR up (t)P 3 , TR up (t)P 4 and TR up (t)P 5 . 

Consequently, in accordance with the second embodiment of the invention, a location 
point Pj acquired at time tj is transformed by a global transformation TR(tj), which comprises 
a succession of successive update transformations TR up at times t-1, t, t+I. Therefore, at time 
30 t, the point Pj acquired at time t-1 is transformed into a transformed point Tr up (t)Pj, which is 
further transformed at time t+1 by an update transformation TR up (t-H) etc. 

A first advantage is that at the current time t the visualized representation R(t) 
corresponds to the live state of the structure in the body. The generated map of the location 
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points is also more realistic. A second advantage is that the computation needs are 
reasonable. 

In a second alternative, a location point Pj acquired at time tj and associated with the 3D 
image data set 3DIS(tj) is successively transformed by a plurality of transformations TRi(tj+i), 
5 . , TRi(t). The location point Pj is transformed at time t into a transformed point TR;(t)Pj by a 
transformation TRi(t), which registers the 3D image data set 3DIS(ti) with the reference 3D 
image data set 3DIS(t); the same location point Pj is further transformed at time t+1 into a 
transformed point TRi(t+l)Pj by a transformation TRi(t+l) which registers the 3D image data 
set 3DIS(tO with the reference 3D image data set 3DIS(t+l) etc. An advantage is that errors 

1 0 due to successive transformations do not accumulate. 

In a third embodiment of the invention, the reference image data set 3DIS(t R ) is 
transformed by a geometrical transformation. The objective of such a geometrical 
transformation is for example to ensure that the structure and consequently the representation 
is visualized by the user in a way he is familiar with. For example, such a geometrical 

15 transformation may place the structure in the center of the 3D image data set or put it in a 
desired orientation. Referring to Fig. 9, an orientation axis OA of the structure 3 may be 
detected in the reference 3D image data set 3DIS(tiO by using image processing techniques 
known to those skilled in the art. A geometrical transformation GT is then defined, which, 
when applied to the structure 3, will place it in the desired position and orientation. Such a 

20 geometrical transformation has to be applied to the transformed location points before 

superimposing them to the reference 3D image data set 3DIS(tR). An advantage is that such a 
geometrically transformed representation can be more easily interpreted by the user. 

In a fourth embodiment of the invention, the visualization means 12 are adapted to 
25 provide a view of a region of interest of the medical instrument 4. Referring to Figs 10A and 
10B, such a view is for instance generated by choosing a plane PI in the reference 3D image 
data set 3DIS R , which contains the tip of the medical instrument 4 and which is perpendicular 
to the medical instrument. This is achieved by defining a slab Sb of the 3D image data set 
centered on this plane PI. The visualization means 12 may advantageously comprise sub- 
30 means for generating a 3D rendered view of this slab on which the transformed location 
points corresponding to this region of interest are superimposed. A first advantage of this 
fourth embodiment of the invention is the possibility to provide a zoom-in of the vicinity of 
the medical instrument 4, which improves the visualization of the region of interest. A second 
advantage is that such a view provides another perspective of the structure 3. Therefore, 
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combined with the representation, such a view may help the user to define a next location for 
performing an action with the medical instrument 4 in a quicker and more efficient way. In 
particular, the vicinity of the entrance of the pulmonary vein in the left atrium is a region of 
great interest, because it plays a role in heart diseases which require burning tissues in this 
5 region of interest. Referring to Figs 10A and 1 OB, a view of the vicinity of the pulmonary 
vein is very likely to help the user decide on a next location for performing an action with the 
medical instrument. 

The invention also relates to a method of mapping a structure of a patient's body using a 
medical instrument and three-dimensional imaging. Referring to Fig. 11, such a method 
10 comprises the steps of: 

- acquiring 20 a plurality of three-dimensional (3D) image data sets 3DIS(ti), 3DIS(t2), . . 
3DIS(t) of a structure 3 of a body of a subject, 

- performing 21a plurality of actions at a plurality of points Pj, P2,. . .Pm in contact with 
said structure, 

15 - associating 22 one of said plurality of points Pj with one of said plurality of 3D image 
data sets 3DIS(t,), 3DIS(t 2 ), . . 3DIS(t), 

- computing 23 a reference 3D image data set (3DIS(tR» from said plurality of 3D image 
data sets (3DIS(t,), 3DIS(t 2 ). . .3DIS(t)), 

- defining 24 a transformation TR(ti) for matching one of said plurality of 3D image data 
20 sets 3DIS(ti) with a reference 3D image data set 3DIS(t R ) comprised within said plurality 

of 3D image data sets, 

- applying 25 said matching transformation TR(tj) to the points Pj of said plurality of points 
Pj, P2,...Pm which are associated with said one of said 3D image data sets 3DIS(ti), 

- visualizing 26 said transformed points TR(tj)Pj. 

25 

The drawings and their description hereinbefore illustrate rather than limit the 
invention. It will be evident that there are numerous alternatives, which fall within the scope 
of the appended claims. In this respect the following closing remarks are made: there are 
30 numerous ways of implementing functions by means of items of hardware or software, or 

both. In this respect, the drawings are very diagrammatic, each representing only one possible 
embodiment of the invention. Thus, although a drawing shows different functions as different 
blocks, this by no means excludes that a single item of hardware or software carries out 
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several functions, nor does it exclude that a single function is carried out by an assembly of 
items of hardware or software, or both. 

Any reference sign in a claim should not be construed as limiting the claim. Use of the 
verb "to comprise" and its conjugations does not exclude the presence of elements or steps 
5 other than those stated in a claim. Use of the article "a" or "an" preceding an element or step 
does not exclude the presence of a plurality of such elements or steps. 
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CLAIMS 

1. A medical imaging system comprising: 

- acquisition means (5) for acquiring a plurality of three-dimensional (3D) image data sets 
5 (3DIS(ti), 3DIS(t 2 ). . .3DIS(t)) of a structure (3) of a body of a subject at times ti, t 2 . ..t, 

- a medical instrument (4) for performing a plurality of actions at a plurality of points (Pi, 
P2, ...Pm) in contact with said structure, 

- means (9) for associating one of said plurality of points (Pj) with one of said plurality of 
3D image data sets (3DIS(tj)), 

10 - means (10) for computing a reference 3D image data set (3DIS(t R )) from said plurality of 
3D image data sets (3DIS(t,), 3DIS(t 2 )_3DIS(t)), 

- means (1 1) for defining a transformation (TR(tj)) for matching said one of said plurality 
of 3D image data sets (3DIS(ti)) with said reference 3D image data set (3DIS(t R )), 

- means (12) for applying said matching transformation (TR(tj)) to the points (Pj) of said 
15 plurality of points which are associated with said one of said plurality of said 3D image 

data sets (3DIS(tO), 

- means (13) for visualizing said transformed points (TR(ti)Pj). 

2. A medical imaging system as claimed in claim 1, wherein said reference image data 
20 set (3DIS(t R ) is a fixed 3D image data set (3DIS(t0). 

3. A medical imaging system as claimed in claim 1, wherein said reference image data 
set (3DIS(t R )) is a current 3D image data set (3DIS(t)). 

25 4. A medical imaging system as claimed in claim 1 , wherein said means for visualizing 
said transformed points (TR(ti)Pj) comprise sub-means for generating a representation 
(R), in which said transformed points are superimposed with said reference 3D image 
data set (3DIS(t R )). 

30 5. A medical imaging system as claimed in claim 2, comprising means for applying said 
current matching transformation (TR(t)) to said current 3D image data set (3DIS(t)), 
and wherein said means for visualizing said transformed points (TR(ti)Pj) comprise 
sub-means for generating a representation (R), in which said transformed points are 
superimposed with said transformed current 3D image data set (TR(3DIS(t))). 
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6. A medical imaging system as claimed in claim 1, wherein said means for visualizing 
said transformed points (TR(tj)Pj) comprise sub-means for generating a view of a 
region of interest of the medical instrument (4), which is perpendicular to a plane (PI) 
comprising an extremity of said medical instrument. 

7. A medical imaging system as claimed in claim 1, comprising means for localizing 
said plurality of location points (Pi, P 2 , . . .Pm) in a fixed referential of coordinates (O, 
x, y, z). 

8. A medical imaging system as claimed in claim 1 , comprising means for localizing 
said plurality of 3D image data sets (3DIS(ti), 3DIS(t 2 )...3DIS(t)) in a fixed 
referential of coordinates (O, x, y, z). 

9. A medical imaging system as claimed in claim 1, wherein said reference image data 
set (3DIS(tR)) has been subjected to a geometrical transformation (GT). 

10. A medical imaging system as claimed in claim 8, wherein said transformation (TR(tj)) 
comprises a first transformation (Tr(tj)) for matching a local referential (O', x 7 , y', 
z , )(ti) of said one of said plurality of 3D image data sets (3DIS(ti)) with a reference 
local referential (0\ x', y', z')(t R ) of said reference 3D image data set (3DIS(t R )) 
within said fixed referential of coordinates (O, x, y, z), and a second transformation 
(Tr'(ti)) for matching a location (Sl(t|)) of said structure (3) in said one of said 
plurality of 3D image data sets (3DIS(ti)) with a reference location (Sl(t R )) of said 
structure in said reference 3D image data set (3DIS(t R )) within said matched local 
referential of coordinates Tr(tj)(0', x', y', z') of said 3D image data set (3DIS(tj)). 

1 1. A medical imaging system as claimed in claim 3, wherein said transformation (TR(tj)) 
comprises successive update transformations (TR up ) for transforming a location of a 
transformed point (Tr up (t-l)Pj) in a previous reference 3D image data set (3DIS R (t~l)) 
acquired at time t-1 into a location TR up (t)Pj) in the current reference 3D image data 
set (3DIS R (t)) acquired at time t. 
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12. A medical imaging system as claimed in claim 3, wherein a new transformation 
(TRi(t)) for matching said one of said plurality of 3D image data sets (3DIS(ti)) with 
said current 3D image data set (3DIS(t)) is applied to said point (Pj) associated with 
said one of said plurality of 3D image data sets (3DIS(tj)) when said reference 3D 

5 image data set (3DIS(t R )) is replaced by said current 3D image data set (3DIS(t)). 

13. A medical imaging system as claimed in claim 1, wherein said structure is a heart and 
said medical instrument is an electrophysiology catheter. 



10 14. A medical imaging system as claimed in claim 1, wherein said association means (9) 

are adapted to associate a point (Pj) acquired at a time tj with a 3D image data set 
(3DIS(tO) acquired at a time tj which is close to time tj. 

15. A medical imaging system as claimed in claim 1, wherein said acquisition means (5) 
1 5 are intended to acquire a plurality of 3D ultrasound image data sets using an 

ultrasound probe (6) arranged on the body of the subject. 



16. A medical imaging method, comprising the steps of: 

- acquiring (20) a plurality of three-dimensional (3D) image data sets (3DIS(ti), 
20 3DIS(t 2 ) . . . 3DIS(t)) of a structure (3) of a body of a subject, 

- performing (2 1) a plurality of actions at a plurality of location points (Pi, P2, . . .Pm) in 
contact with said structure, 

- associating (22) one of said plurality of points (Pj) with one of said plurality of 3D image 
data sets (3DIS(tj)), 

25 - computing (23) a reference 3D image data set (3DIS(t R )) from said plurality of 3D image 
data sets (3DIS(ti), 3DIS(t 2 )...3DIS(t)), 

- defining (24) a transformation (TR(tj)) for matching one of said plurality of 3D image 
data sets with said reference 3D image data set (3DIS(t R) ), 

- applying (25) said matching transformation (TR(tj)) to the location points of said plurality 
30 of location points which are associated with said one of said plurality of 3D image data 

sets, 

' - visualizing (26) said transformed points (TR(tj)Pj). 
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